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Abstract 

We give the first exact determinantal formula for the resultant of an unmixed 
sparse system of four Laurent polynomials in three variables with arbitrary support. 
This follows earlier work by the author on exact formulas for bivariate systems and 
also uses the exterior algebra techniques of Eisenbud and Schreyer. Along the way 
we will prove an interesting new vanishing theorem for the sheaf cohomology of 
divisors on toric varieties. This will also allow us to describe some supports in four 
or more variables for which determinantal formulas for the resultant exist. 
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1 Introduction 



The resultant of n + 1 polynomials fi , . . . , f n+ i in n variables is a single poly- 
nomial in the coefficients of the fi which vanishes when the fi have a common 
root. The resultant can therefore be used to eliminate n variables from n + 1 
equations. Originally resultants were defined for generic polynomials of fixed 
total degrees. More recently a sparse resultant has been defined which exploits 
the monomial structure of the given polynomials. The foundational work was 
laid by Kapranov, Sturmfels, and Zelevinsky [11]. Sparse resultants are dis- 
cussed in depth in the book [9]. 

Formally, let fi, f 2 , . . . , f n +i £ x^ , . . . , x n , x' 1 ] be polynomials with the 
same Newton polytope Q. Let A = Q n Z n . We will assume that A affinely 
generates Z n . 
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We can write: 

fi y ' Ci a X 

We will treat the coefficients C ia as independent variables throughout. 

Definition 1 The A-resultant res^/i, . . . , f n +i) is the irreducible polynomial 
in the ring Z[C ia ], unique up to sign, which vanishes whenever fi, ■ ■ ■ , f n have 
a common root in (C*) n . 

The problem of finding explicit formulas for resultants, and their cousins the 
discriminants, dates back to the nineteenth century with the work of Cayley, 
Sylvester, Bezout and others. With the recent increase in computing power 
there has been a renewed interest in computing resultants and new applications 
in fields such as computer graphics, machine vision, robotic inverse kinematics, 
and molecular structure [13], [14], [7]. 

Even in very small examples, the resultant can have millions of terms. There- 
fore most authors have looked for a more compact representation. A deter- 
minantal formula, following the classical formulas of Sylvester and Bezout, 
writes the resultant as the determinant of a matrix whose entries are easily 
computable polynomials of low degree. In the dense case, when all the polyno- 
mials have the same degree, determinantal formulas are known when n — 1, 2, 
or 3 and for a very few cases in more variables. In the sparse case, n — 1 is 
the same as the dense case and there are the classical Sylvester and Bezout 
formulas, determinantal formulas for n = 2 were found by the author in [12]. 
This paper gives a new exact formula when n = 3. 

Given any lattice polytope Q, let D 1 , . . . , D s denote the facets (codimen- 
sion 1 faces) of Q. Given a subset / = {ii, ■ ■ ■ ,ik} of {1, •••,*}, let Dj = 
{D^, . . . , D ik } be the corresponding subset of facets. Let Dj be the set of 
facets of Q not in Dj. Q — Dj will refer to the set of all points in Q but not 
on any facet on D/. More generally, kQ — Di is the set of all points in the 
Minkowski sum of k copies of Q but not on any of the facets corresponding to 
Di. Finally, given a set S C R n let l(S) = S n Z n be the set of lattice points 
in S. The main theorem is as follows: 

Theorem 2 Let fi, f 2 , fs, E C[x±, x 2 , x 3 , x^ 1 , xj 1 , x^ 1 ] be four polynomials 
with common Newton polytope Qcl 3 . Suppose A = QDZ 3 affinely generates 
Z 3 . Pick a proper collection of the facets of Q, Dj = (D^, . . . , D ik ), such 
that the union of the facets in Di is homeomorphic to a disk. There is a 
determinantal formula for the resultant res a(/i, fi-, fz, fi) of the following block 
form: 

(b l\ 

k L0.j 

The rows of B and L are indexed by the points in l(2Q — Di). The columns of 
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B and L are indexed by l(2Q — Dj). The rows of L are indexed by four copies 
°f KQ ~ Dj), and the columns of L are indexed by four copies of l(Q — Di). 

The entries of B are of Bezout type and are polynomials of degree 4 in the 
coefficients C ia . The entries of L and L are of Sylvester type, thus linear in 
the C ia . 

We will see how the entries of B can be filled in using a free resolution over an 
exterior algebra. Both the proof and the construction are based on techniques 
developed by Eisenbud and Schreyer, which have been adapted for sparse 
resultants (toric varieties). 

The paper is organized as follows. Section 2 discusses the background on toric 
varietes, exterior algebras, and the Tate resolution of Eisenbud-Schreyer. Sec- 
tion 3 uses these techniques along with some sheaf cohomology vanishing re- 
sults to prove Theorem 2. In particular Section 3 contains a new vanishing 
result for certain divisors on any projective toric variety. Section 4 shows how 
to actually construct the resultant matrix and gives some examples. Finally, 
Section 5 gives a different combinatorial perspective on the resultant matrix in 
terms of the Ehrhart polynomial and analyzes the size of the resultant matrix. 



2 Notation and Background 

2. 1 Toric varieties and Chow forms 

Given a polytope Q C lR n and associated A = Q (1 If 1 , let N — \A\. The toric 
variety Xa C P^ -1 is defined as the algebraic closure of the set (x ai : • • • : x aN ) 
where a, ranges over the elements of A and x G (C*) n . It has dimension 
n. In terms of Xa, the polynomials /, are hyperplane sections. The system 
/2j • • • , fn+i) defines a codimension n + 1 plane. The set of all codimension 
n + 1 planes meeting Xa defines a hypersurface in the Grasmannian G(n + 
1, N). The A-resultant is identified with the equation of this hypersurface, also 
called the Chow form of Xa- 

Proposition 3 The resultant resA(/i, • • • , f n +i) — if and only if the fi have 
a common intersection on Xa- 

Let Sq be the normal fan of Q with Eq(1) = {r]i, . . . ,r] s } the inner normals 
to the facets. There is an associated normal toric variety Xy, q (see [8, Chapter 
1]). Assuming A afnnely spans Z n , Xy, q is the normalization of Xa- This is 
essentially Proposition 4.9 in Chapter 5 of [9]. The results below are standard 
and can be found in [8]. 
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Proposition 4 The rji are in 1-1 correspondence with the torus invariant 
prime Weil divisors on Xy, q . Let Di denote the divisor corresponding to rji, 
and 0(A) the corresponding rank 1 reflexive sheaf on X^ Q . 

In the introduction, and statement of Theorem 2, Di denoted a facet of Q. 
This facet will be identified with the corresponding prime divisor, also denoted 
Di, as defined above. 

Given a general divisor D = J2 a iDi on X^ Q , we will denote by Xa (D) or, 
when there is no confusion just 0(D), the push-forward of the sheaf 0x s (D) 
onto X A via the normalization map. The linear equivalence classes of divisors 
are computed by the following exact sequence: 

► Z n Z s — ^ Cl x ► 0, 

where div(u) = ((u, 771) , . . . , (u, rj s , )) and Clx is the cokernel of this map. 
Given a divisor D e Z s we let [D] be the image of D in Clx- 

There is a nice combinatorial description of the global sections H°(X A , 0(D)). 
A divisor D = o-iDi determines a convex polytope Pu = {m G lR n : 
(m,r)i) > —Oi}. For any polytope P, let Sp denote the C vector space with 
basis the lattice points in P, i.e., S P = C{P n II 1 }. 

Proposition 5 

H°(X a ,0(D)) = S Pd . 

If we start with a polytope Q, then it determines an ample divisor on the toric 
variety X^ Q . Write: 

Q = [me W l (m, rji) > -a,, i — l,...,s}, 

for some oi,...,o s 6 Z. Let Dq = o-iDi be the corresponding divisor. If Xa 
is the (possibly non-normal) toric variety above defined by the lattice points 
in Q, then the push-forward of Dq yields the very ample divisor corresponding 
to the embedding of Xa into P^" 1 . On Xj] Q , Dq will always be ample but not 
necessarily very ample. One final useful fact is that the sheaf 0(— J2t=i Di) is 
the canonical sheaf on the Cohen-Macaulay variety X Sq . This will be needed 
when we apply Serre duality below. 

2.2 Exterior algebra and the Tate resolution 

Eisenbud and Schreyer [6] have developed some powerful new machinery to 
compute Chow forms using resolutions over an exterior algebra. Suppose X C 
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F N 1 is a variety of dimension n. We are interested in the finding the Chow 
form of X. 

The ambient projective space P = P^ -1 has the graded coordinate ring R = 
C[Xi, . . . , X N j. If we let W be the C vector space spanned by the X i: (identified 
with the degree 1 part of R), then P is the projectivization P(VF). The ring 
R can also be identified with the symmetric algebra Sym(W). 

Now let V = W*, the dual vector space, with a corresponding dual basis 
ei, . . . 6 7v . We will consider the exterior algebra E — f\V, also a graded algebra 
where the generators e, have degree —1. We will use the standard notation 
E(k) to refer the rank 1 free E'-module generated in degree —k. 

For any coherent sheaf T on P, there is an associated exact complex of graded 
free -E-modules, called the Tate resolution, denoted T^J 7 ). The terms of T(jF) 
can be written in terms of the vector spaces of sheaf cohomology of twists of 
T . Namely, we have: 

T\T) = ®[W{F{e - j)) ® c E{j - e)] (1) 

Here e is any positive integer. In particular, this complex is infinite in both di- 
rections, although the terms themselves are finite dimensional free i?-modules. 

Now suppose that T is supported on X. Recall that the Chow form of X, also 
called the X-resultant and denoted resx, is the defining equation of the set 
of codimension n + 1-planes meeting X. Such a plane is specified by a n + 1 
dimensional subspace Wf = C{/i, . . . , f n +i} C W. Let G be the Grasmannian 
of codimension n + 1-planes on P. Let T be the tautological bundle on G, 
that is to say the fiber at the point corresponding to / is just Wf. There is a 
functor, U n+ i from free i?-modules to vector bundles on G which sends E(p) 
to A p T. 

This functor when applied to the Tate resolution gives a finite complex of 
vector bundles on G, ?7 n+ i(T(J r )) that is fiberwise a finite complex of C vector 
spaces. 

Theorem 6 

det(c4 +1 (T(^))) = res x rank{ ^ 

This is a determinant of a complex, which in general can be computed as a 
certain alternating product of determinants. We will be most interested in the 
special case where the complex in question has only two terms: 

► A B ► 
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In this case, the determinant of the complex is just the determinant of the 
matrix of the map Sheaves whose Tate resolutions yield such two term 
complexes for the Chow form are called weakly Ulrich. Determinantal formulas 
for the resultant correspond to finding a weakly Ulrich sheaf of rank 1 on the 
toric variety Xa- 

Let M = ©j e Ni/ (jF(i)). This is a graded i?-module. The linear strand of the 
Tate resolution is the subcomplex defined by the terms M e <g>E(—e). The maps 
in the linear strand are completely canonical: 

<j) e : M e <g> E(-e) -> M e+1 <g> E(-e - 1) 

N 

m (g) 1 i— > y^^- • Xj <S> e-i 
i=i 

An extremely important fact is that for large enough e, anything larger than 
the regularity of M, all the higher cohomology vanishes and only the linear 
strand remains. For a definition and discussion on regularity see [1]. 

This suggests an algorithm to compute terms of the Tate resolution: 

(1) Given T compute M. 

(2) Pick e = reg(M) + 1 and compute <f> e . 

(3) Start computing a free resolution of <p e over E. 

Note: As a consequence we can read off the cohomology of twists of T as 
graded pieces of this resolution. As Eisenbud, Schreyer, and Fl0ystad [4] point 
out, in many cases this is the most efficient known way to compute sheaf 
cohomology. 



3 Proof of Theorem 2 

Suppose we are given /i,/2,/3,/4 with common Newton polytope Q C ffi 3 . 
To apply the exterior algebra construction we take W = Sq, the C vector 
space with basis the lattice points in Q, and V = Sq. The corresponding 
projective space is P = P(W) = P^" 1 , and the exterior algebra is E = A V. 
Let yi, ■ ■ ■ ,Vn denote the basis of Sq and ei, . . . , ejv the corresponding dual 
basis of E. 

We now show how Theorem 2 reduces to showing that an appropriate push- 
forward of a Weil divisor class onto Xa is a weakly Ulrich sheaf. This will 
require proving that certain cohomology groups vanish. 

Let / C {1, . . . , s}, thought of as a subset of the facets. Let Di = J2i^i A an d 
Di = J2i£i Di be formal sums of the corresponding divisors. The sheaves we 
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will be interested in are of the form kD Q — Dj where k e Z. 

As in the statement of Theorem 2, we pick a proper subset / C {1, . . . , s} 
such that the union of the facets in Dj is homeomorphic to a disk. In Section 
4, while describing the algorithmic construction of the matrix of 2, we also 
show how to pick such Dj as a partial shelling of the facets of Q. We will 
consider the sheaf JF = 0(2Dq — Dj). As before this is a divisor on the normal 
toric variety X^ Q pushed forward onto X\. The main fact we will need is the 
following cohomology vanishing theorem. For simplicity, and when there is no 
confusion, we will often write IP (0(D)) instead of W(X A , 0(D)). 

Theorem 7 Let X = Xq be a projective toric variety of dimension n arising 
from a polytope Q with corresponding ample divisor Dq. Let Dj be a proper 
subset of the facets such that the unions of the facets in Dj is a topological 
manifold with no reduced homology. Then: 

H°(0(kD Q - Dj) = S kQ - Dl 

H i (0(kD Q — Dj) = i = l,...,n-\ 

H n (0(kDq - Dj) = S*_ kQ _^ 

for all k G Z. 

In the case Q is a 3-polytope the only 2-manifold with no reduced homology 
is the disk. The proof is postponed until Section 3.1. But note that plugging 
this into the description of the Tate resolution using T(k) = 0((k + 2)D — Dj) 
gives us: 

Corollary 8 The Tate resolution of T has terms: 

- S* (1 _ e)Q _^ E(3 - e) for e < -1 
T-\F) - S* 2Q _^ ® E(A) © S Q „ Dl ® E(l) 
T\T) - S* Q _ Wi <g) E(3) © S 2Q ^ Dl © E 
T e (^) = S (e+2)Q _ Dl © E(-e) for e > 0. 

Finally, to get the Chow form we need to apply the functor U4 which sends 
E(p) to A P T. But, T is a vector bundle of rank 4, so by the above proposition 
only T~ l (T) and T°(jF) survive the application of U4. Therefore, T is weakly 
Ulrich and the matrix of the resulting two term complex is exactly the matrix 
of Theorem 2 which we restate here in a slightly different language. 

Corollary 9 The resultant of f±, . . . , f± is the determinant of the two term 
complex below: 
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-® \. © -0 

i i o 
Sq-d, ® A T — S *Q-Di ® A T 

Theorem 7 can be used to give exact determinantal formulas for resultants in 
dimension 4 and above for some cases of polytopes. 

Theorem 10 Let Q C M, 4 be a polytope such that A = Q fl Z 4 affinely spans 
Z 4 . There is a determinantal formula for Res a if Q has no interior points and 
there is some facet Di of Q with no relative interior points. 

PROOF. Take T = 0(2D Q - A)- Going through the Tate resolution ma- 
chinery using our vanishing theorem, we get a three term complex whose left 
most term is S* The points here are exactly the interior points of Q to- 
gether with the relative interior points of Dj. So under the given hypothesis, 
this term is zero and we have a two term complex. 

In the case of Xq = P 4 we recover the formulas for resultants of 5 homogeneous 
polynomials of degree less than or equal to 3. We can make a similar statement 
in dimension 5 and higher but the hypotheses get stricter. 

Theorem 11 Let Q C W 1 and A = Q fl Z n affinely spans Z n for n > 5. 
let k\ = L^^J — 2 and k 2 = l" 1 ^] — 2. There is a determinantal formula 
for res a if there is a collection of facets Dj of Q forming a manifold without 
homology such that k\Q and k 2 Q have no interior lattice points, Dj has no 
relative interior lattice points in k 2 Q and Dj has no relative interior points in 
hQ. 

PROOF. Take T = ©(L^JQ - Dj). The result follows from the Theorem 
7 and counting lattice points. 

For example when n = 5 and Q is the coordinate simplex we recover the 
determinantal formula for 6 homogeneous polynomials of degree 2. For n = 6 
or greater we only get a resultant formula for d — 1. It would be interesting 
to classify all polytopes of arbitrary shape satisfying these conditions. It may 
be that there is only be a finite list for n = 6 or greater. 
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We do not claim that these theorems generate all determinantal resultant for- 
mulas. For example, by Proposition 2.6 of [6] if Q\ and Q2 (of any dimension) 
have resultant formulas with sheaves T\ and JF 2 , then T\ <E> T2 will give a 
determinantal formula for Q x x Q 2 . In any case polytopes satisfying Theorem 
11 together with all products of such polynomials is at least a start towards 
classifying exact resultant formulas in higher dimension. 

3.1 Cohomology vanishing 

In this section we will prove Theorem 7. So we will need to compute the co- 
homology of 0(kD Q — Di) for all k e Z. We already know the global sections 
H°(Xa, 0(-)) ■ The next proposition shows how to compute the top cohomol- 
ogy H n (X A ,0(-)). 

Proposition 12 Let Q C M n be a lattice polytope of dimension n with facets 
Di, . . . , D s and A = QnZ n affinely generating 17 l . Let Xa be the corresponding 
toric variety, and D = J2 a^Di a Weil divisor on the normalization X^, Q which 
pushes forward as before to a sheaf on Xa- Then 

H n (X A , 0(D)) = H°(X A , 0(-D - ]T Di))* 

i=i 

PROOF. As per our earlier discussion all of the cohomology can be computed 
on the associated normal toric variety X = X^ Q ■ This is Cohen-Macaulay with 
dualizing sheaf cux = 0(— Ylt=iDi). If D were Cartier the statement would 
follow immediately from Serre duality. In the general Weil divisor case we have 
to be a little bit more careful. So we compute: 



H n (X, 0(D))* = Rom(0(D),co x ) 

= Hom(0(D),Hom(0(j2 A), 0x)) 

i=l 

= Eom(0(D)(E)0(Y / D l ),0 x ) 
i=i 

^Hom(0x,(0(D)®0(EA))*) 

i=i 

*H°(X,(0(D)®0Q2Di)Y)- 

i=l 

The first isomorphism is Serre duality. The second uses that Weil divisors are 
reflexive sheaves and Hom(0(D),0 x ) = 0(D)* = 0(-D). The third and 
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fourth steps are by the adjointness of Tiom and <g>, and the last step is the 
definition of global sections. Finally, by Corollary 2.1 in [10], the dual of any 
coherent sheaf is reflexive. So, 

(0(D) ® 0QT £>,))* = (0(D) ® 0(2 Dj))***. 
i=i i=i 

However (0(£>) <8> 0(i?))** is always isomorphic to 0(£> + -E) even if D and 
E are not locally free. Hence we get 

(0(D) ® 0QT -D/))* = 0(-£> - £ A), 

j= j=l 

as desired. 

It remains to show that the "middle cohomology" always vanishes under the 
given conditions. The proof is broken up into three parts, showing H l (0(kDQ — 
Di)) = when k > 0, k = 0, and k < 0. The first two follow fairly easily from 
results of Mustafa [15], [5]. The case k < requires more work and will be 
quite interesting in its own right. 

Proposition 13 Let Q be a polytope and the toric variety as in Proposi- 
tion 12. Let Di be the sum of any collection of facets as before. H l (0(kDQ — 
Di)) = for alii > and all k > 0. 

PROOF. Since kDg is ample, this is just [15, Corollary 2.5(iii)]. 

In general, the cohomology of all divisors can be grouped into a single object 
Hl(0x) which has a If fine grading: 

Hl(0x) = ® p Hl(0 x ) p . 

where p e Z s . 

The cohomology of a particular divisor class [D] can now be recovered as 

H\0 X (D))=Y.HI(0 X ) P 

v 

where the sum is over all p such that [J^PiDi] = [D]. 

The next lemma can be viewed as a reformulation of a result of [15] yielding 
a topological formula for computing these graded pieces. It shows that in the 
case of a projective toric variety sheaf cohomology can be computed in terms 
of the ordinary homology of pure cell complexes. 
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Lemma 14 / Let p e Z s . Lei J = neg(p) C {1, . . . , s} be the set of coordinates 
for which p is strictly negative. Let \Dj\ be the topological space consisting of 
the union of all the facets Dj with j e J of the polytope Q of X . 

Hl(0 x ) p = H^\\Dj\). 

The latter is the ordinary reduced cohomology of \Dj\. 

PROOF. 

Let Yj be the union of all cones in the fan E having all edges in the complement 
of J. Theorem 2.7 in [5] shows that for i > 1: 

Hi(0 x ) d <*ir-\R n \Yj). 

The latter is isomorphic to LP -1 ^" -1 \ S'™ -1 fl Yj) (excision) which is further 
isomorphic to iJ ri _j_i(S' n ~ 1 fl Yj) by topological Alexander duality. This is 
a subcomplex of the boundary complex of a polytope polar dual to Q. The 
combinatorial Alexander dual is the set of faces of Q whose dual is not in Yj. 
But this is precisely all of those faces of Q contained in some facet Dj. The 
underlying topological space is \Dj\. So, by combinatorial Alexander duality: 

Hn-i-iiS^DY^^H'-WDjl). 

as desired 

We now tackle the case k — 0, the proof of this next proposition was given to 
me in a personal communication with Mircea Mustafa. 

Proposition 15 If the union of the collection of facets in Dj is non-empty 
and homologically trivial, then H l (0(—Di)) = for all i. More generally, 
H i (0(-D I ))^H i - 1 (\D I \) ! 

PROOF. (Due to Mustata) 

H°(0(—D I )) = as the corresponding polytope is empty. Let pi be such 
that (pi)i — — 1 if % G / and (pi)i = 0, otherwise. Clearly, neg(pj) = / and 
E(P/)<A = ~Di- By Lemma 14, Hi(0 x ) pi = H^WD^). 

We now show that if q is such that [EftA] = [— Di], but q ^ pi, then 
H\{0x)q = for all i. Indeed, by linear equivalence q = pi + div(-u), for some 
u E Z d 7^ 0. Let J = neg(g). It is clear that 

J = {i\{u, rji) < or (u,r)i) = and i E 1} 
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Now the above implies there is a hyperplane H C M s which separates the edges 
of Sq indexed by J and J. By [5, Proposition 2.6] this forces Hl(0x) q = 
for i > 1. 



To complete the proof of Theorem 7 we need to consider the case k < 0. This 
will require a new vanishing theorem which has intrinsic interest. Therefore, 
we state it in somewhat more generality than necessary. 

Theorem 16 Let X be a projective toric variety of dimension n, and D a nef 
and big line bundle on X . Let Di = J2iei A be a sum of prime torus invariant 
divisors. If the union of the facets Di with i E I of Q is a topological manifold 
with boundary then H l (X, 0(—D — Dj)) = for all < i < n. 

Proposition 3.3 in [15] states that the fan of X refines the normal fan of Pd 
and 0(D) is the pull-back of an ample divisor, thus we can reduce to the case 
that D is ample. 

Theorem 7 gives general vanishing conditions for all k e Z but the results in 
this section show that the vanishing theorem can be refined using different 
hypotheses for different cases on the integer k. When k > 0, all higher coho- 
mology vanishes for any subset Dj. When k = we need the toplogical space 
\Di\ to have no reduced homology in which case all cohomology vanishes. Fi- 
nally for k < 0, when \Dj\ is a manifold, all cohomology vanishes except at 
the top. 



PROOF. By the remark above assume that D is ample. As before we will 
need to compute Hl(0 x ) p for J2PiDi linearly equivalent to — D — Dj. Let pi 
be defined as in the proof of Proposition 15. Any p as above is of the form 
q — pi where J2 QiDi is linearly equivalent to —D. Write D = J2 CLiDi, in which 
case qi = (u, rji) — <2j for some u G Z n . 

Therefore, 



neg(p) = neg(g) U {i\{u, r]i) = a, t and % e 1} 

Let J' = neg(g) and J = neg(jo) with \Dj>\ and \Dj\ the corresponding unions 
of facets. Since D is an ample divisor, H l (0(—D)) = for i < n, derived for 
example by Proposition 13 and Serre duality. We need to show that under the 
given hypotheses H i (0(-D-D I )) = 0. We know by Lemma 14 WQDj'l) = 
for i < n — 1, and so will need to prove that H l (\Dj\) = 0. 

We have three cases for u: 




and 
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Case 1 (u,rji) < for all i. Equivalently, — u G int(Po). In this case \Dj\ is 
the entire boundary of Pp which is an n — 1 sphere and only has reduced 
homology at the top. 
Case 2 (u, rji) < for all i and (u, rji) = for some i. 

This means that —u is on the boundary of Pp. Since D is ample, Po has 
the same normal fan as Q and so parallel faces to Q. The set of all facets Dj 
for which (u, rjj) = a,j cuts out a face / of Q. Moreover, since — D is Cartier 
there is a corresponding function ip_ D on the fan E, defined to be on 
the rays rji and extended linearly in each cone. Since the linear functional 
(u, ■) agrees with vjj_ D on a spanning set of the cone corresponding to / it 
agrees with ip-D on all of this cone. Therefore, (u, rji) = a» for all facets Di 
containing / and so \Dj\ is the union of all facets of Q not containing /. If 
/ is not a face of a facet in Dj then none of the Dj above are part of Dj, 
in which case neg(p) = neg(g) and therefore H l (\Dj\) = H l (\Dj>\). 

Next, assume that / is a face of some facet in Dj. The facets Dj define 
a cell complex, also denoted Di, realizing the manifold \Dj\. The star st(f ) 
is the union of all of the relatively open faces of Dj that have / as a face 
and the link lk(f) is st(f) - st(f). 

The key observation is that \Dj\ = \Dj>\Ust(f) and lk(f) = \Dji\r\st(f). 
So, we have a Mayer- Vietoris sequence: 

• • • - H a -\lk(f)) - H a (\Dj\) ^ © H a {\D r \) 

We know that st(f) is contractible (it is star shaped!) and from above 
H a (\Dji\) — for a < n - 1. It remains to show that H a ~ l {lk(f)) = for 
a < n — 1. This is where we use that \Di\ is a manifold. 

Start with the cell complex Di and perform a stellar subdivision at the 
face /. This induces a subdivision of Dj, which we call D{, with a new 
vertex Vf corresponding to the face /. Furthermore the star and link st(vf) 
and lk(vf) in D{ are the same as st(f) and lk(f) in Dj. So it now suffices 
to show that H a ~ l (lk(v /)) = for a < n — 1. 

Since \Dj\ is a manifold with boundary, the local cohomology of \Dj\ at 
Vf, H% (\Di\), vanishes for a ^ n— 1 if Vf is an interior point of \Di\, and for 
all a if Vf is on the boundary. This local cohomology can also be computed 
from the triangulation as the relative cohomology H l (st(vf),lk(vf)). The 
long exact sequence in relative cohomology yields: 

• • • - H a -\st{vf)) - H a -\lk(v f )) - H a (st(vf),lk(v f )) 

Since is contractible, H a (st(v f ),lk(v f )) = F° -1 (ZA;(f/)) = for a < 

n — 1 as desired. 
Case 3 (u, 77^) > a, for some z. 

In this case — u is outside the polytope Pp- A point p in is visible from 
— it if the straight line from p to —u meets Pjj first in p. It is easy to see that 
if a visible point p is in the relative interior of a face / then the whole face 
is visible and any subface of a visible face is visible. Therefore visibility is 
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a property of whole faces. A face / of Pd will be called degenerate if —u is 
in the affine span of /. In particular Pjj itself is a degenerate face. A face is 
invisible if it is not visible or degenerate. Any facet containing an invisible 
face must be invisible or degenerate and if every facet containing some face 
/ is degenerate then / itself is degenerate. Clearly, a facet / is visible if and 
only if —u is on the opposite side of / as Pd- Therefore, Dj> is the set of 
invisible facets. Dj is the union of D'j with some degenerate facets. So it 
will suffice to prove the following proposition taking P = P D and v = —u. 

Proposition 17 Let P C W 1 be a polytope of any dimension. Ifv is any point 
in the affine span of P but outside of P, then the union of the invisible facets 
of P together with any collection of degenerate faces is homologically trivial. 



PROOF. We proceed by induction on the number of degenerate faces and the 
dimension of P. If / is a degenerate face of P, so that v is in the affine span of 
/ we can talk about the visible, invisible, and degenerate faces of / regarded 
as a polytope in its own right. It is immediate from the definitions that a 
face of / is visible (invisible, degenerate) if and only if it visible (invisible, 
degenerate) as a face of P. 

To apply the induction we need to show that the intersection of a degenerate 
face / with the union of the invisible facets and some degenerate faces of P is 
precisely the union of the invisible facets of / and some degenerate subfaces. 

We first consider the intersection of a degenerate face / with the union of the 
invisible facets of P. Any invisible facet of / is an invisible face of P and hence 
contained in an invisible facet of P. For the converse, let H be the affine span 
of /. Suppose /' is a face of / contained in an invisible facet F of P. Since u 
is on the same side of F as P, it is on the same side of the intersection of F 
and H as /. In particular there must be some facet of / containing /' invisible 
from u. Hence, the union of the invisible facets of P intersects / precisely in 
the union of its invisible facets. 

Next let / be the intersection of two degenerate faces. Let H be the inter- 
section of the corresponding two affine spans. So H contains both v and / 
and moreover H D P — f. Let H' be the affine span of /, a subspace of H. 
Each facet of P defines a half space containing P. The intersection of all of 
these half spaces for the facets containing / is the convex hull of P and H' . 
Intersecting with H yields just H' . One can instead take all of the opposite 
half spaces and it remains true that the intersection with H is H' . Now if 
none of these facets are invisible from v, then v lies in all of the opposite half 
spaces as above, which means that v lies in H' and thus / is degenerate. In 
conclusion, the intersection of two degenerate faces must either be degenerate 
or contained in an invisible facet. 
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We can now proceed with the induction on the number of degenerate faces. 
Let Po be the union of all the invisible facets of P. This has no reduced 
cohomology since it is the negative support of a negative ample divisor as 
before and therefore has no cohomology below H n ~ x . Since v is outside of P 
there is at least one visible facet and so the set of invisible facets is not the 
whole n — 1-sphere. Therefore, H n ~ l is also 0. 

Assume now that Pi, the union of Po with i degenerate faces, is cohomo logically 
trivial. Let / be a new degenerate face. The Mayer- Vietoris sequence gives us: 

► H a -\f n Pi) -> H a (f U P^ -> H a (f) © H a {Pi) 

As / itself is contractible and Pi is homologically trivial by induction, it suffices 
to show that / n Pi is homologically trivial. However, the above arguments 
show that v is in the affine span of / and / fl Pi is a union of all of the invisible 
facets of / and some degenerate faces of /. Therefore, its cohomology vanishes 
by induction on dimension. The base case is when P is one dimensional, in 
which case for v in the line containing P but not in P, there is exactly one 
invisible facet ( a single point) and no degenerate facets. 

Note, that this proposition, and hence all of Case 3, holds for arbitrary Dj 
and does not use that D I is a manifold. Theorem 7 is an easy consequence of 
all of the above results. 



4 Constructing the resultant matrix 

4-1 Partial shellings 

In this section we show how to choose the A to form a topological ball (disk 
in dimension 2). Of course one can always choose a single facet for Di, but as 
we shall see this does not usually yield the smallest matrices. 

Definition 18 An ordering of the facets Di, . . . ,D S of an n- dimensional poly- 
tope Q, is called a shelling if for i = 2, . . . , s, {D\ U • • • U A-i) H Dj is n — 2 
dimensional and is itself the union of an initial sequence of facets (codimen- 
sion 2 faces in Q) of a shelling of D^. A partial shelling is a proper sequence 
of facets, say D ± , . . . , D t with 1 < t < s, satisfying the same property above. 

When Q has dimension 2, a partial shelling is the same as a connected set of 
edges. In our setting, where Q has dimension 3, being a partial shelling simply 
means that the intersection of each Di with the union of the previous Dj is a 
connected set of edges of Dj. 
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Proposition 19 Let Q be a polytope of dimension 3. The space \Dj\ is home- 
omorphic to a disk if and only if the facets in Dj can be arranged into a partial 
shelling of the boundary ofQ. 



PROOF. It is a standard result that any partial shelling of the boundary of 
a polytope is homemorphic to a ball. In the case of a 3 dimensional polytope 
it is actually a consequence of the Jordan curve theorem. Conversely, every 
topological disk is shellable in dimension two. This last statement fails in 
dimension three and higher. 



It is very easy to actually construct partial shellings for polytopes. A simple 
algorithm is to pass to the polar polytope Q° of Q. Facets of Q correspond 
to vertices of Q°. Next, pick a generic vector in M. n . This will induce a linear 
functional on Q° which by genericity induces a linear order on the vertices. 
One can show that any initial segment of this linear ordering corresponds to 
a partial shelling of the facets of Q. Shellings arising this way are called line 
shellings. 



4-2 Filling in entries 

To actually construct our resultant formula we need to fill in the entries of 
the matrices B, L, and L. We saw above how these arise from a map in a 
Tate resolution. Therefore, we must compute appropriate terms and maps 
in the Tate resolution following the algorithm in Section 2.2 adapted to this 
situation. 

Algorithm 1 

(1) Pick a partial shelling Dj. As we shall see in the next section, in order to 
get a smaller matrix we should pick Dj to have as many boundary points 
as possible. 

(2) Compute the lattice points in 3Q — Dj and AQ — Dj respectively. 

(3) Construct the linear map 4>2 '■ S^q-Dj <8> E — > S^q-Dj <S> E. In light of 
Theorem 8 this is precisely the differential T x (jF) — > T 2 (jF). 

Recall that y { represents a basis element of Sq hence a point in A = 
Q fl Z 3 . So, for every basis element m of S^q-Du ^ the multiplicative 
notation m ■ yi denote the basis element of Saq-Dj obtained by adding the 
two points. This can of course be extended linearly to all of S^q-Dj ■ Now 
the map 2 is explicitly defined by <f)i{vn ® 1) = Y,iLi( m yi ® e d- 

(4) Compute two steps of a graded minimal free resolution, over E, of the 
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cokernel of 02- 

rp-l ^0 ) rpQ <t>l ) rpl <fe ^ j,2 

Since i/iis minimal free resolution is precisely the Tate resolution, the map 
we are interested in is <p . Let M be the corresponding matrix over E. 
The entries of this matrix will be either linear or of degree 4. 
(5) Apply the functor U4 to <p , and therefore M . This is done by replac- 
ing each degree 4 term of the form e^e^e^e^ by the "bracket variable" 
[^1*2*3*4] which represents the 4x4 determinant: 



det 



Clii 


Cu 2 


Cu 3 


Cu 4 










C3ii 






C3i 4 




Caa 2 


C4i 3 


c& 4 



Here Cij is the coefficients of fi corresponding to the monomial repre- 
senting the point yj G A. These entries make up the submatrix B from 
Theorem 2. The remaining rows and columns have linear entries, and 
correspond to L and L. Replace each such row (or column) by 4 rows 
(or columns). The entry ej is replaced by Cu in the first copy, C-2i in 
the second copy, and so on. This procedure is illustrated in the examples 
below. It is a consequence of Lemma 4.2 in [12]. This results in a matrix 
M which is precisely the matrix of Theorem 2. 

Step 4 above requires computing part of a graded minimal resolution over the 
exterior algebra. This can be done using Grobner bases but may be quite time 
consuming. On the other hand this computation needs only be done once to 
compute the resultant of any system with a fixed support. One might hope 
to eliminate the expensive Grobner basis computations by finding explicit 
formulas for the non-trivial maps in the resolution. This was done for the 
two-dimensional resultant in [12] but remains open in the three-dimensional 
case. 



4-3 Examples 



Example 20 Consider the multilinear system: 
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h = Cn + Ci 2 x + C 13 y + C u z + C 15 xy + Ciezz + Ci 7 2/z + C 18 xyz 
h = C21 + C22Z + C*2 3 ?/ + C 24 ^ + C 25 a;|/ + C^zz + C 27 yz + C 28 xyz 
h = C31 + C32X + C 33 y + C342 + C 35 a;|/ + C 36 xz + C 37 ?/z + C 38 xyz 
U = C41 + C 42 x + C 43 t/ + ^44-2 + £45^2/ + C 46 X2; + C A7 yz + C A8 xyz 



The Newton polytope Q of this system is the unit cube in Figure 1. In order 
to apply the resultant algorithm we must choose a partial shelling. So, for 
example, we can pick the left, front, and, right faces as shown. Now l(Q — 
Dj) and, by symmetry, l(Q — Di) are empty while l(2Q — Dj) consists of 
the 6 monomials {xy,xyz,xy 2 ,xyz 2 ,xy 2 z,xy 2 z 2 }, while l(2Q — Dj) consists 
of the 6 monomials {z,xz,yz,x z ,xyz,x 2 yz}. By Theorem 2 the resultant is 
the determinant of a 6 x 6 pure Bezout matrix. To explicitly compute it, we 
construct the linear map S^q-Dj <8> E(l) — > S , 3Q_£i / <8> E and compute one step 
of a free resolution over E. The matrix turns out to be the one shown in Table 
1. 

Note that the size of the matrix depends heavily on the choice of the partial 
shelling. If, on the other hand, we were to choose Dj to consist of the left, 
front, and top facets, then #l(Q — Dj) = #l(Q — Di) = 1, and #l(2Q — Dj) = 
#l(2Q — Dj) = 8. Hence, the matrix from Theorem 2 would be a 12 x 12 
matrix with an 8 x 8 block B, a 8 x 4 block L, a 4 x 8 block L, and a 4 x 4 
block of zeroes. 

If instead we tried the top and bottom facets, not homeomorphic to a disk, we 
would still have l(Q — Dj) and l(Q — Dj) empty. However, this time l(2Q — 
Dj) would consist of 9 points, while l(2Q — Dj) would have only 3 points. 
A closer look at the vanishing theorems shows that we can still get a 9 x 9 
square resultant matrix as there is only other non-vanishing cohomology term 
if 1 (0(— Dj)) = H (\Dj\) = C tensored with /\ 2 T, a vector bundle of rank 6. 
Indeed one can show in general that if\Dj\ is a disjoint union of disks we still 
get an exact matrix formula. 

Example 21 Our next example is the following system: 



h = C n + C 12 x + C 13 y + C 14 z + C^x' 1 + C^y' 1 + C^z' 1 
h = C 2 i + C 22 x + C 23 y + C24Z + C25X- 1 + C^ 1 + C27Z- 1 
h = C31 + C 32 x + C 33 y + C 34 z + C35X- 1 + C^y' 1 + C 31 z~ l 
U = C41 + ^42^ + C A3 y + C M z + C A5 x^ + C m y~ l + C i7 z~ l 
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1 3t 

Fig. 1. Newton Polytope of Example 20 



Table 1 

Resultant Matrix for Example 20 



[1234] 



[1236] - [1245] 



[1237] 



[1256] 



[1238] + [1257] 



[1258] 



[1346] - [1247] [2346] - [1248] [2347] - [1367] -[2456] - [1268] [2348] - [1368] -[1568] - [2458] 
-[1267] - [1456] -[1567] - [2457] 

[1345] [2345] - [1356] -[1357] -[2356] -[2357] - [1358] -[2358] 



[1467] 



[2467] + [1468] 



[3467] 



[2468] 



[3468] - [4567] 



-[4568] 



[1457] + [1348] [1368] + [2348] [1378] - [3457] [2368] - [2567] [1578] + [2378] [2578] - [3568] 
+ [2457] - [1567] +[3458] - [3567] 

-[1478] -[1678] - [2478] -[3478] -[2678] [4578] - [3678] [5678] 



The Newton polytope Q is the octahedron of Figure 2. As our set of facets 
(partial shelling) we choose the x, y, z facet and the three other facets adjoined 
to it by an edge. The chosen facets are shaded in the figure. Now we can see 
that there are 10 points in 1{2Q — Dj) and also by symmetry in l(2Q — Dj). 
There is a single point in l(Q — Dj) (respectively, l(Q — Dj). By Theorem 2 
the resultant is therefore the determinant of a 14x14 matrix shown in Table 2. 
This matrix was found following the algorithm of Section 4-2 by starting with 
the map S^Dq-D; <S> E{1) — > S^Dq-Dj <S> E and computing a free resolution. 

If we were to choose a non-partial shelling such as two facets meeting at a 
single point then the corresponding resultant complex would have nontrivial 
middle cohomology. Indeed, H 2 (—D — Dj) = H 2 {— 2D — Dj) = C. \Dj\ is still 
homologically trivial but it is not a disk. The complex arising from the Tate 
resolution has three terms. 
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Fig. 2. Newton Polytope of Example 21 
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Table 2 

Resultant Matrix for Example 21 

5 Ehrhart polynomials and sizes of resultant matrices 

The results of Section 3 show that the determinant of the matrix of Theorem 
2 is the resultant. In particular, it must be square and the degree of its deter- 
minant is equal to that of the resultant. In this section we give an alternate 
combinatorial proof of these facts. This will also allow us to analyze the size 
of the resultant matrix in order to choose the smallest matrices. 

Consider the Hilbert function of Xa, which turns out to be an honest polyno- 
mial p(x) where the value p(k), for fceN, counts the number of lattice points 
in the polytope kQ. This polynomial is associated to the polytope Q and is 
called the Ehrhart polynomial of Q. There is a very pretty duality theorem 
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involving Ehrhart polynomials. See [8] for details. 

Proposition 22 Let Q be a lattice polytope of dimension n with Ehrhart poly- 
nomial p. Then, (—l) n p(—k) is the number of interior lattice points in kQ. 

Given a collection of facets Dj we are interested in counting the number of 
lattice points in kQ — Dj. A result of Stanley [16] extends Ehrhart polynomials 
and duality in this setting. 

Proposition 23 [16, Proposition 8.2] 

Let Q be a lattice polytope of dimension n, and Dj a collection of facets. 
Suppose \Di\ is homeomorphic to a manifold. Then, there is a polynomial pi 
of degree n, such that pi(k) for k > is the number of points in kQ — Dj, 
(—l) n pi(—k) for k > is the number of lattice points in kQ — Dj, andpj(0) = 
1 — x(\Di\). Here, x(\Di\) is the Euler characteristic of the manifold \Dj\. In 
particuular, if \Dj\ is a disk, then pi(0) = 0. 

The difference p(k) — pi{k), the number of lattice points on the facets Dj in 
kQ, is itself a polynomial of degree (n — 1). 

Going back to resultants, we consider the two term complex appearing in 
Corollary 9 



© © ► 

i i o 

©At 

Let pi(k) be the Ehrhart polynomial of kQ — Dj. This is a cubic polynomial, 
thus the fourth difference is 0. In particular: 

PJ (2) - 4p 7 (l) + 6 P/ (0) - 4 PJ (-1) + Pl {-2) = 0. 

Since \Dj\ homeomorphic to a disk, pi(0) = 0, and the equation can be rewrit- 
ten as pi (2) — 4p/(— 1) = —p I (—2) + 4pi(l). Indentifying the dimension of the 
terms in the diagram above using Proposition 23, this says precisely that the 
matrix is square. 

The total degree is computed by taking 4#/(Q — Dj) entries from L, 4#Z(Q — 
Dj) entries from L and #l(2Q — Di)—4#l(Q — Di) entries from B. The entries 
of L and L are of degree 1, while those of B are of degree 4. So the total degree 



21 



is 4pj(l) - 4pj(-l) + 4(pj(2) - 4pj(l)) = 4(pj(2) - 3 P/ (1) + 3p 7 (0) - pj(-l)). 
This is 4 times the third difference of pi which is the same as 4 times 3! times 
the leading coefficient of pj. This is the same as the leading coefficient of the 
Ehrhart poynomial of Q which is just the Euclidean volume. Hence, the degree 
in question is 4 times the normalized volume which is also the degree of the 
resultant. 

This leads to a technique to analyze the size of the resultant marices. The 
Ehrhart polynomial of Q is of the form p{x) = Ax 3 + Bx 2 + Cx + 1. The 
leading term A is the degree of the toric variety Xa divided by 3!, which is 
the Euclidian volume of Q. Moreover p(l) is the number of lattice points in Q, 
and p(—l) is the negative of the number of interior points. So the number of 
boundary points in Q isp(l)+p(-l) = A+B+C+l-A+B-C+1 = 2B + 2. 
Let Bq = 2B + 2 denote this number. Next, for any partial shelling Dj, we 
write the corresponding quadratic Ehrhart polynomial as qi(x) = ax 2 + bx + l. 
This time q(—l) is equal to the number of relative interior points, so the 
number of boundary points is q(l) — q(— 1) = a + b + 1 — a + b — 1 = 26. Let 
Bj = 2b denote this number. Taking pi(x) = p(x) — qi(x) as above, then the 
total size of the resultant matrix is 



PI (2) - 4 PJ (-1) = p(2) - qi {2) - 4p(-l) + 4 9J (-1) 

= 8A + AB + 2C + 1 - (4a + 2b + 1) - A(-A + B - C + 1) 



8A + 

+ 4(a-6 + 1) 
= 12A + 6C-66. 



Let Iq = —p(—l) = A — B + C — lbe the total number of interior points of 
Q. So C = iq + 1 + B — A. Hence, we can rewrite the above as: 



12A + 6C-6b= 12A + 6(i Q + B - A + 1) - 6b 
= 6A + 3(25 + 2 - 2b) + 6i Q 
= V + 3(B Q - B^ + Qiq. 



Here, V denotes the normalized volume of Q which is 6 times the Euclidian 
volume A. Therefore, in order to minimize the size of the matrix we must 
maximize Bj which is the number of relative boundary points of the union 
of the facets Dj. This gives an obvious lower bound of V for the size of the 
resultant matrix. A more sophisticated argument would give an upper bound 
of 3V when iq is at least I. 
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6 Conclusion 

In this article we showed how the resultant of an unmixed system in three 
variables with arbitrary support can be computed as the determinant of a 
matrix. Combined with the authors earlier results [12], we have now gener- 
alized the formulas for the resultant of homogeneous systems in dimensions 
2 and 3. However, it is still unknown how to make the dimension 3 formula 
completely explicit instead of in terms of a free resolution as presented here. 

For dimension 4 and higher, no general exact formula is known. We do give 
some special cases, although still without an explicit closed form formula, and 
it would be nice to finish this classification. A second approach is to allow 
complexes with more than two terms, yielding resultant formulas with extra- 
neous factors. In the case of projective spaces [2] and products of projective 
spaces [3] the extraneous factors have been identified. It is still open how to 
do this for general toric varieties. 
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